Papers by Ionut Teodor Sorodoc
RAGferee: Building Contextual Reward Models for Retrieval-Augmented Generation (2025.emnlp-main)
Copied to clipboard
Andrei Catalin Coman, Ionut Teodor Sorodoc, Leonardo F. R. Ribeiro, Bill Byrne, James Henderson, Adrià de Gispert
| Challenge: | Existing Reward Models (RMs) struggle in Retrieval Augmented Generation settings. |
| Approach: | They propose a method that repurposes question-answering datasets into preference pairs that prioritise groundedness over stylistic features. |
| Outcome: | The proposed method surpasses existing RMs trained on larger general corpora with an absolute improvement of +15.5%. |
GaRAGe: A Benchmark with Grounding Annotations for RAG Evaluation (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown consistent improvements across many tasks requiring natural language understanding, coding, mathematical or logical reasoning . |
| Approach: | They propose to use GaRAGe to evaluate whether LLMs can identify relevant grounding when generating RAG answers. |
| Outcome: | The proposed model over-summarises rather than ground answers strictly on annotated relevant passages, or deflects when no relevant grounding is available. |